Handheld multi vantage point player

ABSTRACT

The present invention relates to methods and apparatus for utilizing a portable handheld device for viewing streaming video captured from multiple vantage points. More specifically, the present invention presents methods and apparatus for controlling the immersive experience through player configurations for viewing image data captured in two dimensional or three dimensional data formats and from multiple disparate points of capture based on venue specific characteristics, wherein the viewing experience may emulate observance of an event from at least two of the multiple points of capture in specifically chosen locations of a particular venue.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to U.S. Provisional Patent ApplicationSer. No. 62/080,386, filed Nov. 16, 2014, and titled “HANDHELDMULTI-VANTAGE POINT PLAYER”, the entire contents of which areincorporated herein by reference. This application is also acontinuation-in-part to the U.S. patent application with Ser. No.14/719,636, filed May 22, 2015, titled “EVENT SPECIFIC DATA CAPTURE FORMULTI-POINT IMAGE CAPTURE SYSTEMS.” This application is also acontinuation-in-part to the U.S. patent application with Ser. No.14/096,869, filed Dec. 4, 2013, titled “MULTIPLE VANTAGE POINT VIEWINGPLATFORM AND USER INTERFACE.” This application is also acontinuation-in-part to the U.S. patent application with Ser. No.14/532,659, filed Nov. 4, 2014, titled “SWITCHABLE MULTIPLE VIDEO TRACKPLATFORM,” which claims the benefit of U.S. Provisional PatentApplication Ser. No. 61/900,093, filed Nov. 5, 2013, titled “SWITCHABLEMULTIPLE VIDEO TRACK PLATFORM.” This application is also acontinuation-in-part to the U.S. patent application with Ser. No.14/687,752, filed Apr. 15, 2015, titled “VENUE SPECIFIC MULTI POINTIMAGE CAPTURE,” which claims the benefit of U.S. Provisional PatentApplication Ser. No. 61/981,416, filed Apr. 18, 2014, titled “VENUESPECIFIC MULTI POINT IMAGE CAPTURE.” This application is also acontinuation-in-part to the U.S. patent application with Ser. No.14/689,922, filed Apr. 17, 2015, titled “AUDIO CAPTURE FOR MULTI POINTIMAGE CAPTURE SYSTEMS,” which claims the benefit of U.S. ProvisionalPatent Application Ser. No. 61/981,817, filed Apr. 20, 2014, titled“AUDIO CAPTURE FOR MULTI POINT IMAGE CAPTURE SYSTEMS.” The entirecontents of all cross-referenced patent applications and allcross-referenced provisional patent applications are hereby incorporatedby reference.

FIELD OF THE INVENTION

The present invention relates to methods and apparatus for utilizing aportable handheld device for viewing streaming video captured frommultiple vantage points. More specifically, the present inventionpresents methods and apparatus for controlling the immersive experiencethrough player configurations for viewing image data captured in twodimensional or three dimensional data formats and from multipledisparate points of capture based on venue specific characteristics,wherein the viewing experience may emulate observance of an event fromat least two of the multiple points of capture in specifically chosenlocations of a particular venue.

BACKGROUND OF THE INVENTION

Traditional methods of viewing image data generally include viewing avideo stream of images in a sequential format. The viewer is presentedwith image data from a single vantage point at a time. Simple videoincludes streaming of imagery captured from a single image data capturedevice, such as a video camera. More sophisticated productions includesequential viewing of image data captured from more than one vantagepoint and may include viewing image data captured from more than oneimage data capture device.

As video capture has proliferated, popular video viewing forums, such asYouTube™, have arisen to allow for users to choose from a variety ofvideo segments. In many cases, a single event will be captured on videoby more than one user and each user will post a video segment onYouTube. Consequently, it is possible for a viewer to view a singleevent from different vantage points, However, in each instance of theprior art, a viewer must watch a video segment from the perspective ofthe video capture device, and cannot switch between views in asynchronized fashion during video replay. As well, the location of theviewing positions may in general be collected in a relatively randomfashion from positions in a particular venue where video was collectedand made available ad hoc.

Traditionally, when a party has wanted to share or view a video, thesharing and viewing party has been limited to a pre-determined vantagepoint chosen by a person other than the viewer. The director of thevideo content could sort through various vantage points and differentcamera angles, cut the chosen perspectives together, and create a singlefinal video stream. Thus the extent to which a viewer could manipulatethe video source was generally limited to pause, play, and volumecontrol.

The problem with this arrangement is that the director of the videocontent provides a finalized product hoping to have correctly guessedthe viewer's interests. If the director has misjudged the interests ofthe viewer, the viewer has no recourse in choosing a different angle ordifferent vantage point.

What is needed is a product that breaks the control of the director overthe viewer so that the viewer has independent choice in determining thefinal video stream thus giving the viewer an individualized andimmersive viewing experience.

SUMMARY OF THE INVENTION

Accordingly, the present invention provides methods and apparatus fordesigning specific location patterns for the collection of image data ina venue specific manner.

The image data captured from multiple vantage points may be captured asone or both of: two dimensional image data or three dimensional imagedata. The data is synchronized such that a user may view image data frommultiple vantage points, each vantage point being associated with adisparate image capture device. The data is synchronized such that theuser may view image data of an event or subject at an instance in time,or during a specific time sequence, from one or more vantage points.

In some embodiments, locations of image capture apparatus may bedesigned in a venue specific manner based on the design aspects of aparticular venue and the stage setting that is placed within the venue.It may be desirable to provide a user with multiple image capturesequences from different locations in the particular venue. One or moreof stage level, back stage, orchestra, balcony, and standard namedlocations may be included in the set of locations for image captureapparatus. It may also be desirable to select design locations for imagecapture based upon a view path from a particular location to a desiredfocal perspective such as a typical location for a performer orparticipant, the location of performing equipment or a focal point foractivity of a performer or performers. In other embodiments, thelocation of design locations may relate to a desired focal perspectiverelating to locations of spectators at an event.

In some exemplary embodiments, the designed locations of the imagecapture apparatus may be superimposed upon a spatial representation of aspecific venue. Characteristics of the location including, the type ofimage capture device at the location, a positional reference relating toa seating reference in seating zones, or spatial parameters includingdistances, heights and directional information may also be presented toa user upon the superimposed spatial representation. In someembodiments, the spatial representation or virtual representation mayinclude depictions of designed locations superimposed upon graphicrepresentations of a venue and may be presented to a user upon agraphical display apparatus of a workstation.

In some embodiments, the virtual representation may include graphicaldepictions of the view that may be observed from a design location. Thevirtual representation may include a line of sight depiction to a focalpoint in the venue, or in other embodiments may allow for a flexiblerepresentation of a typical view in a set of different directionalvectors from a design point. In other embodiments, the virtualrepresentation may be chosen from a user selectable spectrum ofdirectional possibilities. The virtual representation may in someembodiments include computer generated simulations of the view. In otherembodiments, actual image data may be used to provide the virtualrepresentation of the view from a design location.

In additional embodiments, the specific placement of image captureapparatus within a zonal region of a venue may be influenced by venuespecific characteristic including but not limited to the shape and othercharacteristics of zones for spectators such as seating arrangement inthe zone. In some embodiments, the location of obstructions such ascolumns, speakers, railings, and other venue specific aspects mayinfluence the design for placement of image capture apparatus. In otherembodiments, the location of viewpoints that are not typicallyaccessible to spectators may be included in the design of venue specificimage capture device placement.

In some embodiments, the placement of designed locations for imagecapture devices may be based upon venue specific historical data. Thevenue specific historical data may include the historical demand for aseating location. The demand may relate to rapidity that a location ispurchased for a typical class of performances, the frequency ofoccupation of a particular location or a quantification of historicaloccupation of the location during events, as non-limiting examples. Inother examples, the historical data that may be used may includehistorical prices of tickets paid in a primary or secondary marketenvironment.

In some embodiments, the placement of design locations for image capturemay be based upon venue specific preferences collected from spectatorgroups. In some embodiments, venue specific preferences may be collectedby surveying spectator groups. In other embodiments, a preferenceelection may be solicited in an interactive manner from spectator groupsincluding in a non-limiting perspective by internet-based preferencecollection mechanisms. A virtual representation of a venue along withthe design for a stage or other performance location and historical ordesigned image capture locations may be utilized in the acquisition ofspectator preference collection in some embodiments.

One general aspect includes a handheld multi-vantage point playerincluding: a display; a control system configured to access a server inlogical communication with a communications network; and executablesoftware stored on the control system and executable on demand. Thesoftware may be operative with the control system to cause the controlsystem to provide image vantage point control including logical controlover captured image data, captured from a plurality of image vantagepoints within a venue during a performance event. The software may beoperative with the control system to cause the control system to promptselection of one or more image vantage points. The software may beoperative with the control system to cause the control system to receiveinput selection of the one or more image vantage point. The software maybe operative with the control system to cause the control system toaccess the server, where the server is configured to store the capturedimage data for the performance event. The software may be operative withthe control system to cause the control system to retrieve image datacaptured from the one or more selected image vantage points. Thesoftware may be operative with the control system to cause the controlsystem to display the captured image data retrieved from the one or moreimage vantage points.

Implementations may include one or more of the following features. Thehandheld multi-vantage point player where the control system is furthercaused to: provide audio vantage point control including logical controlover captured audio data, captured from a plurality of audio vantagepoints within the venue during the performance event; prompt selectionof one or more audio vantage points; receive input selection of the oneor more audio vantage points; access the server, where the server isconfigured to store the captured audio data for the performance event;retrieve audio data captured from the one or more selected audio vantagepoints.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, that are incorporated in and constitute apart of this specification, illustrate several embodiments of theinvention and, together with the description, serve to explain theprinciples of the invention:

FIG. 1 illustrates a block diagram of Content Delivery Workflowaccording to some embodiments of the present invention.

FIG. 2 illustrates an exemplary stadium venue with various featuresdelineated in a top-down representation.

FIG. 3 illustrates an exemplary embodiment of a single screen graphicaluser interface (GUI) for a multi-vantage point player.

FIG. 4 illustrates an exemplary embodiment of a multiple, selectedvantage point graphical user interface (GUI) for a multi-vantage pointplayer.

FIG. 5 illustrates an exemplary all vantage point graphical userinterface (GUI) for a multi-vantage point player.

FIG. 6 illustrates apparatus that may be used to implement aspects ofthe present invention including executable software.

FIG. 7 illustrates an exemplary handheld device that may be used toimplement aspects of the present invention including executablesoftware.

FIG. 8A illustrates an exemplary embodiment of an audio graphical userinterface (GUI) for a handheld multi-vantage point player.

FIG. 8B illustrates an exemplary embodiment of an image data graphicaluser interface (GUI) for a handheld multi-vantage point player.

FIG. 8C illustrates an exemplary embodiment of a venue graphical userinterface (GUI) for a handheld multi-vantage point player.

FIG. 9 illustrates exemplary perspective graphs comprising threeseparate perspective points, wherein the three perspective graphs mayillustrate horizontal movement of a handheld device, according to someembodiments of the present disclosure.

FIG. 10 exemplary perspective graphs comprising three separateperspective points, wherein the three perspective graphs may illustratevertical movement of a handheld device, according to some embodiments ofthe present disclosure.

DETAILED DESCRIPTION

The present invention provides generally for the capture, use, andretention of data relating to performances in a specific venue inaddition to the visual and sound data that may be recorded. Techniquesto record visual and audible data may involve the use of multiple videocamera arrays and audio microphones and arrays of audio microphones forthe capture and processing of video and audio data that may be used togenerate visualizations of live performance sound along with imageryfrom a multi-perspective reference. There is other data that may becollected and retained that relates to performances. Such data mayinclude in a non-limiting sense, data related to the environment, localand general, of the performance, data related to the control sequencesfor support equipment, data related to the processing of audio signalsand data related to the control of various lighting and special effects.

In the following sections, detailed descriptions of examples and methodsof the invention will be given. The description of both preferred andalternative examples though through are exemplary only, and it isunderstood that to those skilled in the art that variations,modifications and alterations may be apparent. It is therefore to beunderstood that the examples do not limit the broadness of the aspectsof the underlying invention as defined by the claims.

Definitions

As used herein “Broadcast Truck” refers to a vehicle transportable froma first location to a second location with electronic equipment capableof transmitting captured image data, audio data and video data in anelectronic format, wherein the transmission is to a location remote fromthe location of the Broadcast Truck.

As used herein, “Image Capture Device” refers to apparatus for capturingdigital image data, an Image capture device may be one or both of: a twodimensional camera (sometimes referred to as “2D”) or a threedimensional camera (sometimes referred to as “3D”). In some examples animage capture device includes a charged coupled device (“CCD”) camera.

As used herein, “Production Media Ingest” refers to the collection ofimage data and input of image data into storage for processing, such asTranscoding and Caching. Production Media Ingest may also include thecollection of associated data, such a time sequence, a direction ofimage capture, a viewing angle, 2D or 3D image data collection.

As used herein, “Vantage Point” refers to a location of Image DataCapture in relation to a location of a performance.

As used herein, “Directional Audio” refers to audio data captured from avantage point and from a direction such that the audio data includes atleast one quality that differs from audio data captured from the vantageand a second direction or from an omni-direction capture.

As used herein, “Ambient Data” refers to data and datastreams that arenot audio data or video data.

Referring now to FIG. 1, a Live Production Workflow diagram is presented100 with components that may be used to implement various examples ofthe present invention. Image capture devices, such as for example, oneor both of 360 degree camera arrays 101 and high definition cameras 102may capture image date of an event. In preferred examples, multiplevantage points each may have both a 360 degree camera array 101 and atleast one high definition camera 102 capturing image data of the event.Image capture devices may be arranged for one or more of: planer imagedata capture; oblique image data capture; and perpendicular image datacapture. Some examples may also include audio microphones to capturesound input which accompanies the captured image data.

Additional examples may include camera arrays with multiple viewingangles that are not complete 360 degree camera arrays, for example, insome examples, a camera array may include at least 120 degrees of imagecapture, additional examples include a camera array with at least 180degrees of image capture; and still other examples include a cameraarray with at least 270 degrees of image capture. In various examples,image capture may include cameras arranged to capture image data indirections that are planar or oblique in relation to one another.

A soundboard mix 103 may be used to match recorded audio data withcaptured image data. In some examples, in order to maintainsynchronization, an audio mix may be latency adjusted to account for thetime consumed in stitching 360 degree image signals into cohesive imagepresentation.

A Broadcast Truck 104 includes audio and image data processing equipmentenclosed within a transportable platform, such as, for example, acontainer mounted upon, or attachable to, a semi-truck, a rail car;container ship or other transportable platform. In some examples, aBroadcast Truck will process video signals and perform color correction.Video and audio signals may also be mastered with equipment on theBroadcast Truck to perform on-demand post-production processes.

In some examples, post processing 105 may also include one or more of:encoding; muxing and latency adjustment. By way of non-limiting example,signal based outputs of (“High Definition”) HD cameras may be encoded topredetermined player specifications. In addition, 360 degree files mayalso be re-encoded to a specific player specification. Accordingly,various video and audio signals may be muxed together into a singledigital data stream. In some examples, an automated system may beutilized to perform muxing of image data and audio data.

In some examples, a Broadcast Truck 104A or other assembly of postprocessing equipment may be used to allow a technical director toperform line-edit decisions and pass through to a predetermined player'sautopilot support for multiple camera angles.

A satellite uplink 106 may be used to transmit post process or nativeimage data and audio data. In some examples, by way of non-limitingexample, a muxed signal may be transmitted via satellite uplink at orabout 80 megabytes (Mb/s) by a commercial provider, such as, PSSIGlobal™ or Sureshot™ Transmissions.

In some venues, such as, for example events taking place at a sportsarena a transmission may take place via Level 3 fiber optic lines,otherwise made available for sports broadcasting or other eventbroadcasting. Satellite Bandwidth 107 may be utilized to transmit imagedata and audio data to a Content Delivery Network 108.

As described further below, a Content Delivery Network 108 may include adigital communications network, such as, for example, the Internet.Other network types may include a virtual private network, a cellularnetwork, an Internet Protocol network, or other network that is able toidentify a network access device and transmit data to the network accessdevice. Transmitted data may include, by way of example: transcodedcaptured image data, and associated timing data or metadata.

Referring to FIG. 2, a depiction of an exemplary stadium venue 200 withvarious features delineated may be found in a top-down representation.In a general perspective the types of venues may vary significantly andmay include rock clubs, big rooms, amphitheaters, dance clubs, arenasand stadiums as non-limiting examples. Each of these venue types andperhaps each venue within a type may have differing acousticcharacteristics and different important locations within a venue.Importantly to the discussions herein, each venue and venue type mayhave unique ambient data aspects that may be important to the nature ofthe performance, where ambient data refers to data or datastreams thatare that data other than audio and video data. Collection of some ofthis data may be performed by accessing or locating equipment containingsensors of various kinds with or near specific locations used to recordvisual and audio during a performance. Alternatively, the collection mayoccur through or with the unique building and venue specific systemsthat support a performance.

As a start, it may be useful to consider the various types of locationsthat may occur in an exemplary venue. At exemplary venue 200 a depictionof a stadium venue may be found. A stadium may include a largecollection of seating locations of various different types. There may beseats 215 such as those surrounding region that have an unobstructedclose view to the stage 230 or other performance venue. The audio andvideo characteristics of these locations may be relatively pure, andideal for audio as well since the distance from amplifying equipment isminimal. Other seats such as region 210 may have a side view of thestage 230 or in other examples the performance region. Depending on thenature of the deployment of audio amplifying equipment and of theacoustic performance of the venue setting, such side locations mayreceive a relatively larger amount of reflected and ambient noiseaspects compared to the singular performance audio output. Some seatinglocations such as region 225 may have obstructions including thelocation of other seating regions. These obstructions may have bothvisual and audio relevance. A region 220 may occur that is locatedbehind and in some cases obstructed by venue control locations such assound and lighting control systems 245. The audio results in suchlocations may have impact of their proximity to the control locations.The venue may also have aisles 235 such as where pedestrian traffic maycreate intermittent obstruction to those seating locations there behind.The visual and acoustic and background noise aspects of variouslocations within a venue may be relevant to the design and placement ofequipment related to the recording of both visual and audio signals of aperformance.

In some examples, the location of recording devices may be designed toinclude different types of seating locations. There may be aspects of astadium venue that may make a location undesirable as a design locationfor audio and video capture. At locations 205 numerous columns aredepicted that may be present in the facility. The columns may havevisual or acoustic impact but may also afford mounting locations foraudio and video recording equipment where an elevated location may beestablished without causing an obstruction in its own right. There maybe other features that may be undesirable for planned audio and videocapture locations such as behind handicap access, behind aisles withhigh foot traffic, or in regions where external sound or other externalinterruptive aspects may impact a desired audio and video capture.

The stage 230 or performance region may have numerous aspects thataffect audio and video collection. In some examples, the design of thestage may place performance specific effects on a specific venue. Forexample, the placement of speakers, such as that at location 242 maydefine a dominant aspect of the live audio and video experienced at agiven location within the venue. The presence of performance equipmentsuch as, in a non-limiting sense, drum equipment 241 may also createdifferent aspects of the sound profile emanating from the stage. Theremay be sound control and other performance related equipment 240 onstage that may create specific audio and video and audio and videoretention based considerations. It may be apparent that each venue mayhave specific aspects that differ from other venues even of the sametype, and that the specific stage or performance layout may createperformance specific aspects in addition to the venue specific aspects.

A stadium venue may have rafters and walkways at elevated positions. Insome examples such elevated locations may be used to support or hangaudio and video devices from. In some examples, apparatus supported fromelevated support positions such as rafters may be configured to captureaudio and video data while moving.

It may be apparent that specific venues of a particular venue type mayhave different characteristics relevant to the placement of audio andvideo capture apparatus. For other types of data collection, theselocations for audio and video capture apparatus may be defaultlocations. In a non-limiting sense, there may be temperature, pressure,humidity and other environmental sensors that may be collocated at thevideo and audio collection locations. There may be other locations aswell where such environmental sensing apparatus is placed. Although, themulti-location video data streams may be useful to triangulate locationsof sensing equipment, the exact location of the equipment may becalculated, sensed or measured by various techniques and may compriseother types of data that may be recorded in the recording of aperformance. Environmental data as an example may provide parametricvalues that may be useful in algorithmic treatment of recorded data orbe of interest from a historical recording perspective. There may alsobe control streams of data that are sent to the audio and videorecording systems such as external directional signals, focusing, zoom,filtering and the like. These control signals may also comprise datastreams that may be collected and recorded along a time sequence. Theremay be other control signals that operate during a performance, and thecollection of these data streams will be discussed in later sections.

It may be further apparent that different types of venues may also havedifferent characteristics relevant to the placement of the audio andvideo capture apparatus as well as the other types of data streams. In asimilar vein, since the location of some ambient data collectionequipment may in some examples mirror the placement of image captureapparatus, the aspects of a venue related to image capture may createdefault locations for other data capture. In some examples, the natureand location of regions in a specific venue, including venue installedambient sensors, may be characterized and stored in a repository. Insome examples, the venue characterization may be stored in a database.The database may be used by algorithms to present a display of a seatingmap of a specific venue along with the types of environmental sensorsand control systems that may be found within the venue. In someexamples, the display of various ambient data collection apparatuscharacteristics and locations may be made via a graphical displaystation connected to a processor.

Referring now to FIG. 3, an exemplary embodiment of a single screengraphical user interface (GUI) 300 for a multi-vantage point player isillustrated. In some aspects, a user may select a single video screen335 from a particular vantage point 336 and audio control 345 over fiveaudio vantage points 350, 35, 360, 365, 370. The user may select generalenvironment control 375, wherein the user may control the relativeintensity of the environment feedback on a spectrum slider 376. In someembodiments, a venue diagram 310 may indicate the selected audio vantagepoints 312 and the selected video vantage point 311.

In some embodiments, a user may be able to navigate perspective 395 froma particular vantage point, and in some embodiments, the user maypreselect multiple vantage points that the user may migrate amongthroughout a performance. In some aspects, the video controls 380 maycomprise a zoom spectrum 385 and a perspective graph 390.

The perspective graph 390 may represent the three-dimensional spacearound an attendee in a specific seat. In some aspects, the centralpoint of the axes may comprise the head of an attendee, wherein spaceabove the attendee's head may be located along the positive y axis andthe space below may be located along the negative y axis. The space infront of the attendee's head may be located along the positive z, whichmay be directed to the stage, and the space behind the attendee's headmay be located along the negative z axis, which may be directed awayfrom the stage. The areas to the left and right of the attendee's headmay be located along the positive x axis and negative x axis,respectively. In some alternative examples, the central point maycomprise a specific camera at a vantage point. In some aspects, forexample where the selected video vantage point may be captured by a 360°camera, the central point may comprise the camera. In some aspects, auser may move a focal point 395 to change the viewing range 396.

A change of viewing area may trigger a change in audio because of thevirtual change in ear position. In some embodiments, audio may comprisedirectly collected audio from specific audio feeds arranged within thevenue. Alternatively, audio may comprise an algorithm-based audioderived from multiple audio feeds.

The single screen GUI 300 may present a time sync bar 305 and generalplayer controls 320, wherein a user may control and navigate the timingof the experience. For example, a user may want to rewatch or skipcertain clips within the performance. In some implementations, thepresentation may be a live experience, in contrast to a rebroadcast. Insome such aspects, the fast forward or skipping options may not beapplicable, and the time sync bar 305 may be fluid, as the preciseduration may not be known.

In some embodiments, the player may allow the user to adjust audiocontrol 345, viewing area 396, and zoom 385 throughout the event. Inother embodiments, the player may present configuration choices andsamples prior to the event, allowing the user to select theconfigurations that may be fixed through the event.

In some embodiments, a user may toggle between the GUIs 300, 400, 500presented in FIGS. 3-5. For example, the single screen GUI 300 maypresent a multiple, selected vantage point GUI icon 325 and an allvantage point GUI icon 330, wherein a user may click on either icon 325,330 to jump to the selected GUI 400, 500, respectively. Alternatively, auser may click directly on the screen 335, wherein the GUI may bespecified by a right or left click. For example, a right click on thescreen 335 may prompt the multiple selected vantage GUI 400, and a leftclick may prompt the all vantage point GUI 500.

Referring to FIG. 4, an exemplary embodiment of a multiple, selectedvantage point graphical user interface (GUI) 400 for a multi-vantagepoint player illustrated. In contrast to the single screen GUI 300illustrated in FIG. 3, a multiple, selected vantage point GUI 400 mayallow a user to view multiple screens from different selected vantagepoints simultaneously. The control layout may be similar to the singlescreen GUI 300, wherein a venue diagram 410 may indicate the selectedvideo vantage points 411 and the selected audio vantage points 412.

In some aspects, the video controls 475 may comprise a position choice480 and a perspective graph 485. The position choice 480 may allow auser to experience the live event from a standing or seated position. Asdescribed in FIG. 3, the perspective graph 485 may represent thethree-dimensional space around an attendee in a specific. In someaspects, for example where the selected video vantage point may becaptured by a 360° camera, the central point may comprise the camera. Insome aspects, a user may move a focal point 488 to change the viewingrange 487.

In some aspects, the GUI 400 may present multiple screens 420, 425, 430,435. In some aspects, where a user may experience an event from multiplevantage points simultaneously, the GUI 400 may simultaneously presentscreens 420, 425, 430, 435 captured or streaming video from each vantagepoint 421, 426, 431, 436. In other aspects, a user may experience anevent from multiple vantage points in succession, wherein one screen mayactively play or stream video at any one time.

In some embodiments, a user may individually configure settings for eachvideo vantage point. In some aspects, a user may toggle control betweeneach of the screens 420, 425, 430, 435, wherein a user may configure thesettings for a selected video vantage point. A user may configure videocontrol 475, environment control 470, and audio control 440 for aparticular video vantage point. For example, for each video vantagepoint, the user may specify a volume level for audio from each selectedaudio vantage point 445, 450, 455, 460, 465; may specify the intensityof special effects data 471; and may specify the position and viewingrange 487.

In some embodiments, the multiple, selected vantage point GUI 400 maypresent a time sync bar 305 and a master player control 415, wherein auser may control all content simultaneously. Alternatively or incombination with a master player control 415, each control segment mayhave a general control comprising, for example, icons for play, pause,rewind, and fast forward.

In some aspects, the multiple, selected vantage point GUI 400 maypresent a single screen GUI icon 490 and an all vantage point GUI icon495, wherein a user may toggle between the GUI options. Alternatively, auser may right click to prompt the all vantage point GUI 500 or leftclick to prompt the single screen GUI 300. In some aspects, promptingthe single screen GUI 300 may default to the preselected vantage pointscreen, or a user may be prompted to select the desired vantage pointfrom the current multiple, selected GUI 400.

Referring now to FIG. 5, an exemplary all vantage point graphical userinterface (GUI) 500 for a multi-vantage point player is illustrated. Insome embodiments, the all vantage point GUI 500 may present a user withvideo options 515, audio options 520, environment options 525, and avenue diagram 505, wherein each video and/or audio vantage point 510 maybe indicated. In some embodiments, the player may limit the number ofvideo and audio vantage points a user may control and/or view/listen toat one time.

In some aspects, the video options 515 may present a grid of screens530, wherein a user may select screens 530 from one or more videovantage points 532, such as, for example, by toggling a radio button531. In some embodiments, the video feed samples displayed for eachvantage point may be extracted from a stock exemplary event or may beplayed live from the event. In some implementations, the user may beable to further control the perspective from a vantage point, which maybe an option in a second GUI, such as illustrated in FIGS. 3 and 4. Insome embodiments, the user may preselect from a variety of vantagepoints, which may allow the user to migrate between the vantage pointsduring the concert. In some embodiments, the player may allow a user toview the event from multiple vantage points simultaneously, such asdescribed and illustrated in FIG. 4.

In some embodiments, video capture may be achieved through use of avariety of types of cameras, wherein some cameras may capture highdefinition imagery and/or a 360° view. In such embodiments, the allvantage point GUI 500 may indicate camera capabilities for each vantagepoint, such as with an “HD” 540 or a three-axis icon 535. In someembodiments, some cameras may not be active for every event, and aninactive vantage point may be indicated by a faded screen or an x over ascreen and a strike through the vantage point title 545.

In some aspects, the audio options 520 may present a list of the audiovantage points 551, wherein a user may select audio from one or moreaudio vantage points 551, such as, for example, by toggling a radiobutton 550. In some embodiments, the specific vantage point 551 may beclickable, wherein a click may temporarily activate the audio from thatvantage point 551. Alternatively, not shown, an all vantage point GUI500 may present a play button next to each vantage point 551, which maytrigger an audio sample. In some embodiments, the sample may beextracted from a stock exemplary event or may be played live from theevent. In some implementations, some microphones may not be active forevery event, wherein an inactive vantage point may be indicated by astrike through 565.

In some embodiments, the audio may be achieved through a variety ofmicrophones, wherein the microphones may capture unidirectional,bidirectional, or omnidirectional audio. In such implementations, theaudio options 520 may indicate special microphone capabilities with abidirectional icon or an omnidirectional icon, for example. In suchexample, the unidirectional audio capture may be the default and may notrequire a microphone capability icon.

In some implementations, environment options 525 may present thedifferent environmental data types 571 captured for the particularvenue, which may comprise ambient, video, and/or audio data. Forexample, crowd noise or backstage noise may be captured as audio,special effects may be captured as audio in conjunction with video, andtemperature may be captured as ambient data. Alternatively, a user mayselect general control 570 over environmental data, wherein a user maycontrol the intensity of the presentation of environmental data as awhole or according to a predefined algorithm.

Similarly to the single screen GUI 300 and the multiple, selectedvantage point GUI 400, the all vantage point GUI 500 may presentalternate GUI icons 575, 580 so that a user may toggle between GUIs 300,400, 500. The all vantage point GUI 300 may present a single screen GUIicon 575 and a multiple, selected vantage point GUI icon 580. In someembodiments, a user may be prompted to select the desired vantagepoints, whereas in other embodiments, the player may assume the selectedor last selected vantage points may be the desired vantage points.

Apparatus

In addition, FIG. 6 illustrates a controller 600 that may be utilized toimplement some embodiments of the present invention. The controller maybe included in one or more of the apparatus described above, such as theRevolver Server, and the Network Access Device. The controller 600comprises a processor unit 610, such as one or more semiconductor basedprocessors, coupled to a communication device 620 configured tocommunicate via a communication network (not shown in FIG. 6). Thecommunication device 620 may be used to communicate, for example, withone or more online devices, such as a personal computer, laptop, or ahandheld device.

The processor 610 is also in communication with a storage device 630.The storage device 630 may comprise any appropriate information storagedevice, including combinations of magnetic storage devices (e.g.,magnetic tape and hard disk drives), optical storage devices, and/orsemiconductor memory devices such as Random Access Memory (RAM) devicesand Read Only Memory (ROM) devices.

The storage device 630 can store a software program 640 for controllingthe processor 610. The processor 610 performs instructions of thesoftware program 640, and thereby operates in accordance with thepresent invention. The processor 610 may also cause the communicationdevice 620 to transmit information, including, in some instances,control commands to operate apparatus to implement the processesdescribed above. The storage device 630 can additionally store relateddata in a database 650 and database 660, as needed.

Referring now to FIG. 7, a block diagram of an exemplary mobile device702. The mobile device 702 comprises an optical capture device 708 tocapture an image and convert it to machine-compatible data, and anoptical path 706, typically a lens, an aperture or an image conduit toconvey the image from the rendered document to the optical capturedevice 708. The optical capture device 708 may incorporate aCharge-Coupled Device (CCD), a Complementary Metal Oxide Semiconductor(CMOS) imaging device, or an optical sensor of another type.

A microphone 710 and associated circuitry may convert the sound of theenvironment, including spoken words, into machine-compatible signals.Input facilities 714 exist in the form of buttons, scroll wheels, orother tactile sensors such as touch-pads. In some embodiments, inputfacilities 714 may include a touchscreen display.

Visual feedback 732 to the user is possible through a visual display,touchscreen display, or indicator lights. Audible feedback 734 may comefrom a loudspeaker or other audio transducer. Tactile feedback may comefrom a vibrate module 736.

A motion sensor 738 and associated circuity convert the motion of themobile device 702 into machine-compatible signals. The motion sensor 738may comprise an accelerometer that may be used to sense measurablephysical acceleration, orientation, vibration, and other movements. Insome embodiments the motion sensor 738 may include a gyroscope or otherdevice to sense different motions.

A location sensor 740 and associated circuitry may be used to determinethe location of the device. The location sensor 740 may detect GlobalPosition System (GPS) radio signals from satellites or may also useassisted GPS where the mobile device may use a cellular network todecrease the time necessary to determine location. In some embodiments,the location sensor 740 may use radio waves to determine the distancefrom known radio sources such as cellular towers to determine thelocation of the mobile device 702. In some embodiments these radiosignals may be used in addition to GPS.

The mobile device 702 comprises logic 726 to interact with the variousother components, possibly processing the received signals intodifferent formats and/or interpretations. Logic 726 may be operable toread and write data and program instructions stored in associatedstorage 730 such as RAM, ROM, flash, or other suitable memory. It mayread a time signal from the clock unit 728. In some embodiments, themobile device 702 may have an on-board power supply 732. In otherembodiments, the mobile device 702 may be powered from a tetheredconnection to another device, such as a Universal Serial Bus (USB)connection.

The mobile device 702 also includes a network interface 716 tocommunicate data to a network and/or an associated computing device.Network interface 716 may provide two-way data communication. Forexample, network interface 716 may operate according to the internetprotocol. As another example, network interface 716 may be a local areanetwork (LAN) card allowing a data communication connection to acompatible LAN. As another example, network interface 716 may be acellular antennae and associated circuitry which may allow the mobiledevice to communicate over standard wireless data communicationnetworks. In some implementations, network interface 716 may include aUniversal Serial Bus (USB) to supply power or transmit data. In someembodiments other wireless links may also be implemented.

As an example of one use of mobile device 702, a reader may scan sometext from a newspaper article with mobile device 702. The text isscanned as a bit-mapped image via the optical capture device 708. Logic726 causes the bit-mapped image to be stored in memory 730 with anassociated time-stamp read from the clock unit 728. Logic 726 may alsoperform optical character recognition (OCR) or other post-scanprocessing on the bit-mapped image to convert it to text. Logic 726 mayoptionally extract a signature from the image, for example by performinga convolution-like process to locate repeating occurrences ofcharacters, symbols or objects, and determine the distance or number ofother characters, symbols, or objects between these repeated elements.The reader may then upload the bit-mapped image (or text or othersignature, if post-scan processing has been performed by logic 726) toan associated computer via network interface 716.

As an example of another use of mobile device 702, a reader may capturesome text from an article as an audio file by using microphone 710 as anacoustic capture port. Logic 726 causes audio file to be stored inmemory 728. Logic 726 may also perform voice recognition or otherpost-scan processing on the audio file to convert it to text. As above,the reader may then upload the audio file (or text produced by post-scanprocessing performed by logic 726) to an associated computer via networkinterface 716.

Referring now to FIGS. 8A-8C, exemplary graphical user interfaces forexperience control for a handheld device are illustrated. In someembodiments, a user may be able to toggle between audio GUI 800 andvideo GUI 820, which may allow for higher visibility and more convenientcontrol in comparison to a simultaneous video and audio controlpresentation. In some alternative aspects, the user may select simplecontrols, wherein both video and audio control may be accessible fromthe same screen. As illustrated in FIG. 8C, selection of the image andaudio vantage points may be presented on a venue GUI 850.

In still further embodiments, the video and audio control options may beselected, such as illustrated and described in reference to FIG. 5. Insome aspects, the mobile device may comprise a touch responsive screen,wherein a user may adjust the video controls by interacting directlywith the screen, such as through recognized gestures. For example, auser may control the zoom level by pinching the screen and may controlthe viewing area by swiping the screen.

In some embodiments, a user may toggle between video control and audiocontrol. In some such embodiments, the toggle may be controllablethrough eye movement recognition, similarly to finger gestures that maycontrol a mobile device.

In some embodiments, the handheld device may be in logical communicationwith a secondary device, such as a remote or mobile device. Thesecondary device may control one or both the audio or video. In someembodiments, a remote may comprise control functions based ondifferentiating tactile indicators. Tactile differentiation may allow auser to utilize a remote without having to interrupt the immersiveexperience. In some embodiments, tactile indicators may be programmedinto a mobile device, such as a tablet or smartphone, wherein the mobiledevice may vibrate in a predetermined pattern based on the specificcontrols. For example, a mobile device may vibrate twice in quicksuccession to indicate to the user that he has activated the immersionaudio control. The user may then move their finger up or down to controlthe balance. In some embodiments, the relative motion of the finger onthe mobile device may adjust the audio, wherein the user may not berequired to touch a specific point on the mobile device. Suchembodiments may be convenient for mobile devices where the screen may besmooth, without tactile distinctive portions.

Referring now to FIG. 9, exemplary perspective graphs comprising threeseparate perspective points, wherein the three perspective graphs mayillustrate horizontal movement of a handheld device, according to someembodiments of the present disclosure, are illustrated. In someembodiments, the handheld device may comprise an accelerometerconfigured to detect movement. Similarly to the eye position detection,the accelerometer may be calibrated to the natural head movements of auser. In some embodiments, the calibration may allow the user to tailorthe range to the desired viewing area. For example, a user may be ableto move their head 110° comfortably, and the calibration may allow theuser to view the entire 180° relative the natural 110° movement.

A neutral position 920 of the handheld device may allow the user to viewa forward-looking perspective 925. A right position 940 of the handhelddevice may allow the user to view a rightward-looking perspective 945. Aleft position 960 of the handheld device may allow the user to view aleftward-looking perspective 965.

Referring now to FIG. 10, exemplary perspective graphs comprising threeseparate perspective points, wherein the three perspective graphs mayillustrate horizontal movement of a handheld device, according to someembodiments of the present disclosure, are illustrated. In someembodiments, the handheld device may be configured to detect verticalmotions. In some aspects, a user may move the handheld device up toshift the viewing area to a range in the positive y axis grids, and usermay move the handheld device down to shift the viewing area to a rangein the negative y axis grids. In some embodiments, the handheld devicemay be configured to detect both horizontal and vertical motion, whereinthe user may be able to have almost a 270° viewing range.

A neutral position 1020 of the handheld device may allow the user toview a forward-looking perspective 1025. An up position 1040 of thehandheld device may allow the user to view an upward-looking perspective1045. A down position 1060 of the handheld device may allow the user toview a downward-looking perspective 1065.

In still further embodiments, the handheld device may be able to detect360° of horizontal movement, wherein the user may completely turn aroundand change the neutral viewing range by 180°. In some aspects, thehandheld device may be configured to detect whether the user may besitting or standing, which may shift the perspective and viewing area.In some implementations, a user may be allowed to activate or deactivatethe motion detection levels, based on preference and need. For example,a user may want to shift between sitting and standing throughout theexperience without a shift in perspective. In some implementations, thehandheld device may further comprise speakers, wherein audio data may bedirected to the user.

In some aspects, a handheld device may operate similarly to the wearabledisplay device, wherein a user may control the viewing area andperspective by moving the handheld device. In some embodiments, theplayer may utilize accelerometers included in the handheld device.Alternatively, a user may attach a dongle

In some aspects, a user may be prompted to calibrate the displaymechanism, wherein the calibration may establish a comfortable neutralposition. In some aspects, particularly for handheld devices, thecalibration may occur prior to a live event or even during, such as whena user may move to a different location with the device.

In some aspects, the video options may allow the user to select viewsfrom one or more vantage points, such as, for example, by toggling aradio button. In some implementations, the user may be able to furthercontrol the perspective from a vantage point, which may be an option ina second GUI, such as illustrated in FIGS. 6 and 7.

SPECIFIC EXAMPLES OF EQUIPMENT

Apparatus described herein may be included, for example in one or moresmart devices such as, for example: a mobile phone, tablet ortraditional computer such as laptop or microcomputer or an Internetready TV.

The above described platform may be used to implement various featuresand systems available to users. For example, in some embodiments, a userwill provide all or most navigation. Software, which is executable upondemand, may be used in conjunction with a processor to provide seamlessnavigation of 360/3D/panoramic video footage with DirectionalAudio—switching between multiple 360/3D/panoramic cameras and user willbe able to experience a continuous audio and video experience.

Additional embodiments may include the system described automaticpredetermined navigation amongst multiple 360/3D/panoramic cameras.Navigation may be automatic to the end user but the experience eithercontrolled by the director or producer or some other designated staffbased on their own judgment.

Still other embodiments allow a user to participate in the design andplacement of imaging recording equipment for a specific performance at aspecific venue. Once the image capture apparatus is placed and placed inuse a user may record a user defined sequence of image and audio contentwith navigation of 360/3D/panoramic video footage, Directional Audio,switching between multiple 360/3D/panoramic cameras. In someembodiments, user defined recordations may include audio, text or imagedata overlays. A user may thereby act as a producer with theMulti-Vantage point data, including directional video and audio data andrecord a User Produced multimedia segment of a performance. The UserProduced may be made available via a distributed network, such as theInternet for viewers to view, and, in some embodiments further edit themultimedia segments themselves.

Directional Audio may be captured via an apparatus that is located at aVantage Point and records audio from a directional perspective, such asa directional microphone in electrical communication with an audiostorage device. Other apparatus that is not directional, such as an omnidirectional microphone may also be used to capture and record a streamof audio data; however such data is not directional audio data. A usermay be provided a choice of audio streams captured from a particularvantage point at particular time in a sequence.

In some embodiments a User may have manual control in auto mode. TheUser is able to manually control by actions such as swipe or equivalentto switch between MVPs or between HD and 360. In still furtherembodiments, a user may interact with a graphical depiction of aspecific venue where image capture elements have been indicatedthereupon.

In some additional embodiments, an Auto launch Mobile Remote App maylaunch as soon as video is transferred from iPad to TV using AppleAirplay. Using tools, such as, for example, Apple's Airplay technology,a user may stream a video feed from iPad or iPhone to a TV which isconnected to Apple TV. When a user moves the video stream to TV,automatically mobile remote application launches on iPad or iPhone isconnected/synched to the system. Computer Systems may be used todisplays video streams and switches seamlessly between 360/3D/Panoramicvideos and High Definition (HD) videos.

In some embodiments that implement Manual control, executable softwareallows a user to switch between 360/3D/Panoramic video and HighDefinition (HD) video without interruptions to a viewing experience ofthe user. The user is able to switch between HD and any of the multiplevantage points coming as part of the panoramic video footage.

In some embodiments that implement Automatic control a computerimplemented method (software) that allows its users to experienceseamlessly navigation between 360/3D/Panoramic video and HD video.Navigation is either controlled a producer or director or a trainedtechnician based on their own judgment.

Manual Control and Manual Control systems may be run on a portablecomputer such as a mobile phone, tablet or traditional computer such aslaptop or microcomputer. In various embodiments, functionality mayinclude: Panoramic Video Interactivity, Tag human and inanimate objectsin panoramic video footage; interactivity for the user in tagging humansas well as inanimate objects; sharing of these tags in real time withother friends or followers in your social network/social graph;Panoramic Image Slices to provide the ability to slice images/photos outof Panoramic videos; real time processing that allows users to sliceimages of any size from panoramic video footage over a computer;allowing users to purchase objects or items of interest in aninteractive panoramic video footage; ability to share panoramic imagesslides from panoramic videos via email, sms (smart message service) orthrough social networks; share or send panoramic images to other usersof a similar application or via the use of SMS, email, and socialnetwork sharing; ability to “tag” human and inanimate objects withinPanoramic Image slices; real time “tagging” of human and inanimateobjects in the panoramic image; allowing users to purchase objects oritems of interest in an interactive panoramic video footage; content andcommerce layer on top of the video footage—that recognizes objects thatare already tagged for purchase or adding to user's wish list; abilityto compare footage from various camera sources in real time; real timecomparison panoramic video footage from multiple cameras captured bymultiple users or otherwise to identify the best footage based onaspects such as visual clarity, audio clarity, lighting, focus and otherdetails; recognition of unique users based on the user's devices thatare used for capturing the video footage (brand, model #, MAC address,IP address, etc.); radar navigation of which camera footage is beingdisplayed on the screens amongst many other sources of camera feeds;navigation matrix of panoramic video viewports that in a particulargeographic location or venue; user generated content that can beembedded on top of the panoramic video that maps exactly to the timecodes of video feeds; time code mapping done between production qualityvideo feed and user generated video feeds; user interactivity with theability to remotely vote for a song or an act/song while watching apanoramic video and effect outcome at venue. Software allows forinteractivity on the user front and also ability to aggregate thefeedback in a backend platform that is accessible by individuals who canact on the interactive data; ability to offer “bidding” capability topanoramic video audience over a computer network, bidding will haveaspects of gamification wherein results may be based on multiple userparticipation (triggers based on conditions such # of bids, type ofbids, timing); Heads Up Display (HUD) with a display that identifiesanimate and inanimate objects in the live video feed whereinidentification may be tracked at an end server and associated data madeavailable to front end clients.

CONCLUSION

A number of embodiments of the present invention have been described.While this specification contains many specific implementation details,there should not be construed as limitations on the scope of anyinventions or of what may be claimed, but rather as descriptions offeatures specific to particular embodiments of the present invention.

Certain features that are described in this specification in the contextof separate embodiments can also be implemented in combination in asingle embodiment. Conversely, various features that are described inthe context of a single embodiment can also be implemented incombination in multiple embodiments separately or in any suitablesub-combination. Moreover, although features may be described above asacting in certain combinations and even initially claimed as such, oneor more features from a claimed combination can in some cases be excisedfrom the combination, and the claimed combination may be directed to asub-combination or variation of a sub-combination.

Similarly, while operations are depicted in the drawings in a particularorder, this should not be understood as requiring that such operationsbe performed in the particular order shown or in sequential order, orthat all illustrated operations be performed, to achieve desirableresults. In certain circumstances, multitasking and parallel processingmay be advantageous.

Moreover, the separation of various system components in the embodimentsdescribed above should not be understood as requiring such separation inall embodiments, and it should be understood that the described programcomponents and systems can generally be integrated together in a singlesoftware product or packaged into multiple software products.

Thus, particular embodiments of the subject matter have been described.Other embodiments are within the scope of the following claims. In somecases, the actions recited in the claims can be performed in a differentorder and still achieve desirable results. In addition, the processesdepicted in the accompanying figures do not necessarily require theparticular order show, or sequential order, to achieve desirableresults. In certain implementations, multitasking and parallelprocessing may be advantageous. Nevertheless, it will be understood thatvarious modifications may be made without departing from the spirit andscope of the claimed invention.

What is claimed is:
 1. A handheld multi-vantage point player to be heldin the hand of a user comprising: a display; an accelerometer fixedlyattached to the wearable display calibrated to detect hand movement; acontrol system configured to access a server in logical communicationwith a communications network, wherein the control system is configuredto accept and register a plurality of finger gestures, wherein theplurality of finger gestures comprise predefined tactile motions; andexecutable software stored on the control system and executable ondemand, the software operative with the control system to cause thecontrol system to: provide image vantage point control comprisinglogical control over captured image data, captured from a plurality ofimage vantage points within a venue during a performance event, whichcameras are placed according to venue-specific historical data; promptselection of multiple image vantage points; receive input selectiondesignating one of the multiple image vantage points; register a neutralhand position of the user comprising a central point of a three axesspace around the hand position comprising a positive Y axis above thehand, a negative Y axis below the hand, a positive Z direction towards astage, a negative Z direction away from the stage, and areas to the leftand right of the hand comprising an X axis; register a current handposition of the user in relation to the neutral hand position with aninitial X axis value, Y axis value, and Z axis value; access the server,wherein the server is configured to store the captured image data forthe performance event; retrieve image data captured with a 360 degreecamera and correlating to the X axis, Y axis, and Z axis from the serverbased upon the designated image vantage point and the current handposition of the user in relation to the neutral hand position and 360degree camera and correlating to the X axis, Y axis, and Z axis; anddisplay the captured image data retrieved from the server based upon thedesignated image vantage points, the X axis, Y axis, and Z axis and thecurrent hand position of the user, designating respective values foreach of the X axis, Y axis, and Z axis.
 2. The handheld multi-vantagepoint player of claim 1, wherein the control system is further causedto: provide audio vantage point control comprising logical control overcaptured audio data, captured from a plurality of audio vantage pointswithin the venue during the performance event, which audio vantagepoints are chosen according to venue-specific historical data; promptselection of one or more audio vantage points; receive input selectionof the one or more audio vantage points; access the server, wherein theserver is configured to store the captured audio data for theperformance event; retrieve audio data captured from the one or moreselected audio vantage points; and play the captured audio data ofselected audio vantage points.
 3. The handheld multi-vantage pointplayer of claim 2, wherein the selection of one or more audio vantagepoints is predefined by a third party.
 4. The handheld multi-vantagepoint player of claim 2, wherein the selection of one or more audiovantage points is controllable by the user.
 5. The multi-vantage pointplayer of claim 2, wherein the image vantage point control furthercomprises a change in perspective based upon the accelerometercommunicating to the processor a movement of the handheld display; andthe processor is additionally operative to display new image data basedupon the movement of the wearable display.
 6. The multi-vantage pointplayer of claim 5, wherein the perspective control comprises a zoomcontrol and a positive change in a y-axis of viewing area based upon theuser changing a hand position towards looking up, and a negative changein a y-axis viewing area based upon the user changing a hand positiontowards looking down; and a positive change in an x-axis based upon theuser changing a hand position towards aiming the device to the right anda negative change in the x-axis based upon the user changing a handposition towards aiming the device to the left.
 7. The handheldmulti-vantage point player of claim 5, further comprising anaccelerometer logically linked to the control system, wherein theaccelerometer is configured to detect movement of the handheldmulti-vantage point player.
 8. The handheld multi-vantage point playerof claim 7, wherein the image data display is controllable by detectedmovement of the handheld multi-vantage point player.
 9. The handheldmulti-vantage point player of claim 1, wherein the control system isfurther caused to disable at least one application concurrently with thedisplay of the captured image data.
 10. The handheld multi-vantage pointplayer of claim 1, wherein the handheld multi-vantage point playercomprises a smartphone.
 11. The handheld multi-vantage point player ofclaim 1, wherein the handheld multi-vantage point player comprises atablet.
 12. The handheld multi-vantage point player of claim 1, whereinthe handheld multi-vantage point player comprises a handheld gamingdevice.
 13. The handheld multi-vantage point player of claim 1, whereinthe handheld multi-vantage point player, while streaming a liveperformance of a concert, occasionally prompts the user to bid on a songthe user would like the performer to perform, wherein the bid comprisesat least one of: a vote, or a specified amount of money.
 14. Thehandheld multi-vantage point player of claim 6, wherein the executablesoftware is further configured to associate captured audio and videodata with a time index.
 15. The handheld multi-vantage point player ofclaim 14, wherein the handheld multi-vantage point player is configuredto display captured audio and video data at a selected time index from aselected vantage point, based upon changes in acceleration detected bythe accelerometer.